arXiv: 1507.05713vl [cond-mat.stat-mech] 21Jul2015 


Meaning of temperature in different thermostatistical ensembles 


Peter Hanggi, 1 ’ 2 Stefan Hilbert, 3 E and Jorn Dunkel 4 

institute of Physics, University of Augsburg, Universitatsstrafle 1, D-86135 Augsburg, Germany 
2 Nanosystems Initiative Munich, Schellingstr. f, D-80799 Munchen, Germany 
3 Exzellenzcluster Universe, Boltzmannstr. 2, D-85748 Garching, Germany 
4 Department of Mathematics, Massachusetts Institute of Technology, 

77 Massachusetts Avenue E17-fl2, Cambridge, MA 02139-4307, USA 
(Dated: July 22, 2015) 

Depending on the exact experimental conditions, the thermodynamic properties of physical sys¬ 
tems can be related to one or more thermostatistical ensembles. Here, we survey the notion of 
thermodynamic temperature in different statistical ensembles, focusing in particular on subtleties 
that arise when ensembles become non-equivalent. The ‘mother’ of all ensembles, the microcanonical 
ensemble, uses entropy and internal energy (the most fundamental, dynamically conserved quantity) 
to derive temperature as a secondary thermodynamic variable. Over the past century, some confu¬ 
sion has been caused by the fact that several competing microcanonical entropy definitions are used 
in the literature, most commonly the volume and surface entropies introduced by Gibbs. It can be 
proved, however, that only the volume entropy satisfies exactly the traditional form of the laws of 
thermodynamics for a broad class of physical systems, including all standard classical Hamiltonian 
systems, regardless of their size. This mathematically rigorous fact implies that negative ‘absolute’ 
temperatures and Carnot efficiencies > 1 are not achievable within a standard thermodynamical 
framework. As an important offspring of microcanonical thermostatistics, we shall briefly consider 
the canonical ensemble and comment on the validity of the Boltzmann weight factor. We conclude 
by addressing open mathematical problems that arise for systems with discrete energy spectrum. 
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I. INTRODUCTION 


The fundamental differential relation [T] 


1 _ dS 
T~ dE 


(1) 


connects the thermodynamic state functions temperature T, internal energy E, and entropy S. Given S' as a function 
of E, and possibly other control parameters, Eq. ([I]) in fact defines the thermodynamic temperature. The concept of 
entropy was introduced by Rudolf Clausius [2] hr 1865. Clausius chose the symbol S in honor of (Nicolas Leonard) 
Sadi Carnot, who laid the groundwork for the Second Law of Thermodynamics. The celebrated Clausius relation 
dS = 5Q/T identifies the inverse of the thermodynamic temperature T as the integrating factor for the Second Law, 
with 5Q = 0 denoting quasi-static and reversible infinitesimal heat exchange. After Clausius’ seminal paper [2], it took 
about 30 more years until Gibbs [3] , Einstein, Planck nog and others [B] were able to connect firmly thermodynamics 
and statistical mechanics - and yet certain aspects of this connection have remained a subject of debate up to this 
day. 

The standard approach in statistical mechanics is to identify thermodynamic state functions with specific average 
values of a suitably chosen statistical ensemble that correctly reflects the physical conditions under which measure¬ 
ments are performed (perfect isolation, coupling to an energy or matter reservoir, etc.). The most fundamental 
statistical ensemble is the microcanonical ensemble (MCE), describing the thermodynamics of isolated systems that 
are governed by energy conservation and which, at equilibrium, cannot exchange heat or matter with their surround¬ 
ings. The MCE is the foundation of other thermostatistical ensembles, including the canonical ensemble (which 
permits permanent energy and/or heat exchange with the environment) and the grand-canonical ensemble (which 
allows both energy and matter exchange). These two subordinate ensembles can be derived from the MCE by consid¬ 
ering a subsystem of interest that is weakly coupled to the rest of the globally isolated microcanonical system, which 
is then interpreted as an environment (heat bath or particle reservoir) for the particular subsystem. 
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Recent experimental advances make it possible to investigate thermodynamic properties of very small systems 
(single molecules, Brownian colloids or even individual atoms) that may be, in good approximation, decoupled from 
the environment or that can be in weak or strong contact with a much larger system. Such finite-system studies 
provide a valuable testbed for the notion and meaning of thermodynamic temperature in the context of various 
statistical ensembles. Particularly interesting from a theoretical and practical perspective are situations in which 
different ensemble descriptions are not guaranteed to be equivalent. Ensemble inequivalence is more norm than 
exception in finite-size systems but can also occur in macroscopic systems with long-range interactions or when the 
density of states (DoS) is a nonmonotic function of energy. Equilibrium systems of the latter type are often classified 
as anomalous jJJ and, if entropy is chosen naively, they can give rise to the paradoxical notion of a negative ‘absolute 
’ temperature. 

In the remainder of this contribution, we will survey the meaning of temperature in thermodynamics by summarizing 
and commenting on results from recent more detailed studies 00- 


II. MICROCANONICAL THERMODYNAMICS AND ABSOLUTE TEMPERATURE 

The MCE describes the thermostatistics of a strictly isolated system through the density operator p = S(E — H)/uj, 
where the normalization constant u is the density of states (DoS). The MCE is the most fundamental ensemble as it 
only relies on the conservation of energy E, arising from the time-translation invariance of the underlying Hamiltonian 
H. External thermodynamic control parameters Z , such as available system volume, particle numbers, electric or 
magnetic fields, enter as parameters through the Hamiltonian H(Z ) and the DoS ui(E,Z). To connect the MCE 
to thermodynamics, J. W. Gibbs [3] studied two different candidates for the thermodynamic entropy of an isolated 
system. The first is the volume entropy, which in modern notation takes the form 

S G = k B lnfl(E,Z) . (2) 

Here, k B denotes the Boltzmann constant and the dimensionless volume-quantity Cl(E, Z) is the integrated DoS, 
classically obtained by integrating the non-negative DoS w > 0 up to energy E, 

pE 

Q(E,Z)= dE'u>(E', Z), (3) 

J o 

assuming zero ground-state energy for a physically stable system. Since H is non-decreasing function of E, the 
temperature Tq obtained from Sq and Eq. (nj is strictly non-negative. 

For classical Hamiltonian systems H(t;,Z) with phase-space variables £, the integrated DoS fl(E,Z) equals the 
properly normalized (via division by the symmetries of the degrees of freedom) and dimensionless (via division by 
the appropriate power of Planck’s constant) integrated phase space volume up to the energy E. We may write this 
formally as 


Q(E,Z)=7rte[E-H(S,Z)] (4) 

where 0 denotes the unit-step function and Tr the phase-space integral over distinguishable microstates £. For 
isolated quantum systems with discrete energy spectrum, £ comprises the complete set of quantum numbers, and we 
may interpret H in Eq. @ as a discrete level counting function, defined on the spectrum {E n } of the Hamiltonian. 
Intuitively, the discrete function fl(E n , Z) sums the eigenspace dimensions of the eigenvalues Ej < E n . In the quantum 
case, one needs to postulate additional smoothing procedures before one can apply differential thermodynamic relations 
such as Eq. |l]) (see discussion in Sec. |IV| b elow). 

Following Gibbs’ seminal work, Hertz |6J demonstrated the mechanical adiabatic invariance of the volume entropy 
Sq for classical systems. The exact connection between Sq, its corresponding temperature Tq and equipartition for 
classical finite size systems was emphasized in early works by Schliiter [5] and Khinchin m- More recent discussions 
and applications of the Gibbs’ volume entropy can be found in Refs. 0Q3HI2]. 

The second microcanonical entropy candidate studied by Gibbs [3] is the surface entropy 

Sb = k B ln[w(E, Z)e]. (5) 

The quantity e denotes an arbitrary energy constant, needed to make the argument of the logarithm dimensionless. 
That the definition of 5 b requires such an additional ad hoc parameter is conceptually unappealing, but bears no 
relevance for thermodynamic quantities that are related to derivatives of S B (E,Z ) - provided e is assumed to be 
independent of (E, Z). One can show however that the presence of e can cause 5 b to violate Planck’s formulation of 
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the Second Law (7j. For discrete quantum systems with singular DoS w, Eq. (|5j) also requires additional interpolation 
and/or smoothing procedures (see Sec. IV). The subscript ‘B’ in Eq. ([5]) signals that this definition is also commonly 
referred to as Boltzmann entropy nowadays, which unfortunately does not seem to reflect properly the actual history. 
Although Boltzmann’s tombstone famously carries the entropy formula 5 = kp, log W, it was, according to Arnold 
Sommerfeld HU, Max Planck [Jj [5] who first established this relation. As described in many textbooks, the entropy 
expression 5 b in Eq. ([5]) can be heuristically obtained by identifying log = In and interpreting W = ew(£, Z) as 
the number of microstates accessible to a physical system at energy E. This may explain the popularity of the term 
‘Boltzmann entropy’. 

It is well known that for macroscopic normal systems [T] with a large number of microscopic degrees of freedom, 
most of the phase space volume is contained in a narrow shell just below the energy E. In such cases, the two entropy 
definitions become essentially indistinguishable and predict practically identical thermodynamic equations of state. 
There exists, however, a wide range of systems for which 5 b and 5 q are non-equivalent. 


A. Self-consistency checks 

The question as to whether Sq or 5 b are viable candidates for the thermodynamic entropy of isolated systems, 
can be answered directly by testing either candidate against the Laws of Thermodynamics. The approximation-free 
analysis in Ref. J7] shows that for a broad class of physical systems, which includes all standard classical Hamiltonian 
systems 1 of arbitrary size, the Gibbs volume entropy 5 q satisfies the traditional formulations of the Zeroth, First and 
Second Law exactly. In contrast, the surface entropy 5 b is found to violate these laws in many situations Guam. 
While referring the reader to Ref. 7j for technical details, we briefly summarize the most essential results. 

i. That 5g, but not 5b, satisfies the Zeroth Law is a reflection of the fact 13 EE os men HU that only 5q 
satisfies the microcanonical equipartition theorem exactly. More precisely, denoting the microcanonical averages by 
{•}e, the Stokes theorem implies m implies that, for all standard classical Hamiltonian systems with topologically 
simple phase space the equipartition identity 2 


k-nTo = 




( 6 ) 


holds for any of the canonical coordinates (£-],... ,£d)- By contrast, this relation is in general violated for the surface 
entropy, ruling out 5 b as a consistent thermodynamic entropy. 


ii. Compliance of 5 = 5q and T = Tq with the First Law 


dS = —dE - 
T 


T.Y dz " 


F -"= T 


dH' 


(7) 


follows directly from a simple integration by parts dim. Note that the last equality in Eq. 0 ensures that statistical 
averages agree with thermodynamic observables. One can easily verify that this consistency criterion is, in general, 
violated for the Boltzmann entropy 5b- 


in. Planck’s Second Law of Thermodynamics for isolated systems can be, in essence, stated as follows: Consider 
two isolated microcanonical systems that are initially separated and have entropies 5i(£i) and 52 (£’ 2 ); respectively. 
Now couple the two systems weakly and let them equilibrate. Assuming energy conservation throughout the process, 
the joint equilibrated system is again microcanonical and has entropy 5 i_|_2(-E' 1 - 1 - 2 ) = 5i+2(£l + £ 2 )- Then, Planck’s 
Second Law demands that the entropy of the final state is larger than the sum of the initial entropies, 

5i +2 (£i + 2 ) > 5i(£i) + 5 2 (£ 2 ). (8) 


1 These are confined systems with quadratic kinetic energy and finite ground-state energy. 

2 For systems with complex phase space topology, Eq. § can be violated, see example in Sec. |II B] below, where the phase space regions 
corresponding clockwise and anti-clockwise motion become disconnected for supercritical energy values. Such topologically peculiar 
systems do not thermalize in the traditional sense. However, for the most commonly considered standard classical Hamiltonian systems, 
Eq. © is strictly satisfied. 
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Basic integral convolution properties imply that Eq. Q is always satisfied for Sq (in most cases, even with strictly ‘>’) 
but not necessarily by Sb ,Zj- 

In this context, it is worthwhile to note that any subsequent attempt to decouple the two systems results in non- 
microcanonical distributions for the separated systems, since the exact individual energies are not known anymore 
due to the permanent energy exchange during the equilibration phase (i.e., thermal coupling is irreversible). This 
means that, without further manipulation or measurements (or the introduction of a Maxwell demon), the total 
entropy remains S i+ 2 (-®i + E 2 ) after separation, a fact that has been missed by authors jlf)| who recently criticized 
the Gibbs entropy. Unsurprisingly, this basic error led to paradoxical conclusions m, such as an apparent violation 
of mathematically exact inequalities. 

For completeness, we mention that previous studies rarely focused on the Third Law, mainly because it is well known 
that many classical systems (including the ideal gas) do not obey the Third Law. Typically, verification of the Third 
Law requires a consistent quantum-mechanical treatment 3 . Evidently, the Gibbs entropy satisfies Sg(Eq) = kslTigo 
with g 0 denoting the degeneracy of the ground state energy E 0 and hence fulfills the most basic version of the Third 
Law. 


B. Positive and negative absolute temperatures: an example 


The primary thermodynamic state variables of an isolated system with Hamiltonian H(Z) = E are energy E and 
control parameters Z. By contrast, the temperature T is a secondary derived quantity determined by Eq. ([I]). For 
the Gibbs volume entropy, one finds explicitly 


&B?G 


Q(E,Z) 
uj(E, Z)' 


u(E,Z) 


on 

dE' 


(9) 


Since both the integrated DoS H > 0 and the DoS w > 0 are non-negative, the Gibbs temperature is strictly non¬ 
negative. For comparison, the Boltzmann temperature is given by 


^B^B 


v(E,Z) 

v(E, Z) ’ 


v(E,Z) 


du 

dE' 


( 10 ) 


The Boltzmann temperature Tb is negative whenever the DoS ui is a locally decreasing with E (see example in Fig. [I]). 
This happens for Ising-type spin or laser systems in the population inverted system, as well is in Hamiltonian systems 
exhibiting singular points in their DoS that separate regions of v(E, Z) > 0 with regions with negative-valued ^(E, Z). 

An instructive ergodic ID example m is the classical pendulum (mass to, length L, gravitational acceleration g) 
with Hamiltonian 





mgL cos </>. 


( 11 ) 


The energy range is bounded from below but unbounded from above, 0 < E < oo. The DoS w can be given analytically 
in terms of complete elliptic integrals of the first kind (see in Ref. m and Fig. 1 therein). The DoS increases in the 
oscillatory regime 0 < E < mgL , exhibits a singularity at E = mgL , where the orbit period diverges, and decreases in 
the continuous-rotation regime, mgL < E < oo. Accordingly, v(E > mgL) < 0 decays monotonically towards zero as 
E —► oo, implying a negative Boltzmann temperature for E > mgL. By contrast, the Gibbs temperature is positive 
for all E > 0. In particular, for E mgL , any further increase of energy is, in essence, purely kinetic and the system 
approaches an ideal one-particle gas on a circle, which should asymptotically satisfy E = +1/sbT, unless one is willing 
to give up this standard caloric equation of state. It easy to check that this relation holds only for T = Tq. 


C. Additional remarks 

Heat does not always flow from hot to cold. The thermodynamic state of an isolated system is completely 
determined by the primary state variables ( E,Z ). Since temperature is not a primary state variable, it cannot, in 


3 As a note of caution: One can find many partially conflicting versions of the Third Law in the literature, and some naive formulations are 
not applicable to isolated systems, or only apply to systems with non-degenerate ground-state or finite energy gap between ground-state 
and lowest excited energy levels. 
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FIG. 1: Non-uniqueness of microcanonical temperatures for a system with nonmonotonic density of states (DoS); figure 
adapted from Ref. [7 . (a): DoS u> (red, dashed) and integrated DoS D (blue) for the example in Eq. (23) of Ref. [7]. (b): Gibbs 
volume entropy 5g (blue) and Boltzmann surface entropy 5b (red, dashed) in units &b = 1- (c): Gibbs temperature Tg (blue) 
and Boltzmann temperature 7 b (red, dashed). The example illustrates that, in general, neither the Gibbs nor the Boltzmann 
temperature uniquely characterize the thermal state of an isolated system because the same temperature value can correspond 
to different energy values. 


general, uniquely characterize the thermodynamic state of a microcanonical system (see Fig. [I]). This means there 
exist situations where neither the Gibbs temperature Tg nor the Boltzmann temperature Tb can predict the energy 
flow between weakly coupled systems that had different temperatures before contact [7]. For instance, for a system 
with oscillatory DoS, two or more significantly different energy values can have the same temperature, regardless 
of which entropy definition one adopts (see Fig. 0)- Therefore, the naive formulation of the Second Law ‘heat 
always flows from hot to cold’ does not hold in general. Likewise invalid are versions of the Zeroth Law that claim 
that isolated systems with equal temperatures should not produce a net heat flow between them when brought into 
thermal contact. This can again be readily seen by considering, for example, the coupling of an ideal gas to a system 
with oscillatory DoS as in Fig. [Tj 

Thermodynamics applies to equilibrium systems of any size. It takes little effort to verify that Eqs. M 
hold exactly for standard classical Hamiltonian systems with an arbitrary number of degrees of freedom N. Similarly, 
the canonical ensemble discussed below can be applied to (sub-)systems of any size. These mathematical facts 
are widely appreciated by many colleagues ® eh m nil in] in particular those interested in understanding DNA 
folding (21| , microscopic information storage and erasure |22j and fluctuation phenomena |23j - and yet remain ignored 
by others EH El]. When judged objectively, there is no doubt that the application of thermodynamic concepts to finite 
systems has considerably advanced our understanding of biophysical, colloidal and quantum processes 4 . Compared 
with infinite-systems thermodynamics, a practical difference is given by the fact that fluctuations generally play 
a (much) more important role in small systems. The presence of fluctuations, of course, does not mean that it 
is forbidden to characterize single DNA molecules thermodynamically; on the contrary, such fluctuations typically 
contain important additional thermodynamic and energetic information that is usually lost in the infinite-system limit. 
Therefore, it would seem wiser to focus on understanding better the fluctuations of thermostatistical variables in finite 
systems, such as those of virial quantities on the rhs. of Eq. ([7]), instead of discarding finite-system thermodynamics 
on purely habitual grounds [ 231 . Dogmatic insistence on the thermodynamic limit N —> oo is about as useful as 
insisting on the Newtonian limit, corresponding to speed of light c —I oo, in relativity. In both cases, things may 
become simpler, but one is missing out on relevant physics. 

Clausius relation &; Carnot efficiency. Campisi [8] showed recently that the inverse Gibbs temperature Tg 1 
appears naturally as the integrating factor in the Clausius relation for virtually all practically relevant physical systems. 
This corroborates the fact that the Gibbs temperature Tq should be identified with the absolute thermodynamic 
temperature T, unless one is willing to abandon the Clausius relation. Moreover, the non-negativity of the Gibbs 
temperature directly implies that Carnot efficiencies cannot exceed 1. 


4 Most of the experimental applications involve the canonical ensemble, as DNA molecules m or colloids [221123| are typically held 
in a liquid bath that acts as a canonical thermostat. However, if one accepts the applicability of canonical thermostatistics to finite 
systems, then there exist no mathematical or logical or physical reasons that forbid the application of microcanonical statistics to finite 
systems, because Eqs. |6])-([8]) hold for systems of any size. Of course, the thermostatistical characterization of small systems should not 
just be limited to the mean values appearing in Eqs. ^ and 0 but should also include a careful fluctuation analysis of the underlying 
stochastic observables. 
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Thermodynamic potentials can be ‘nonlocal’. It is sometimes argued that the Gibbs entropy cannot be the 
‘correct’ thermodynamic entropy as it is based on the integrated phase-space volume H, which is a ‘nonlocal’ quantity 
that arises from a summation over states in an extended energy range. This argument might appear superficially 
appealing but it is ill-founded for (at least) two reasons: First, the microcanonical averages appearing in Eqs. © 
and Q are computed purely locally on the energy surface in phase space. Yet, the Stokes theorem implies that 
they can be related to the enclosed phase-space volume [ID] and, hence, entropy should be a nonlocal volume-related 
quantity. Second, if we insisted on purely local potentials everywhere in physics then we would have to stop using force 
potentials in mechanics, which are in essence ‘non-local’ integrals over local forces experienced by particles. At this 
point, however, it is helpful to recall why such non-local potentials are introduced in mechanics in the first place: They 
allow us to define an important conserved quantity, energy. Just as the energy is invariant under infinitesimal time 
translations, the integrated phase-space volume f l is invariant under infinitesimal adiabatic parameter translations [B], 
Hence, it should not be surprising but rather be expected that thermodynamic potentials may be non-local in energy 
space. 

Ising models are bad benchmarks. When using specific theoretical models to illustrate alleged pros and cons of 
certain entropy definitions, then it is advisable to verify first that these models respect superordinate experimentally 
established knowledge. Specifically, while the observed stability of matter implies the existence of lower energy 
bounds on Hamiltonians, there exists no evidence to date for strict upper energy bounds. This means that E —> —E 
is not a fundamental symmetry of physics and, hence, one should not impose such energy-reflection symmetry on 
thermodynamic quantities. For the same reason, it is not advisable to base arguments exclusively on Ising-type 
models, which are ad hoc truncations of more fundamental Hamiltonians that are not bounded from above, if one 
wants to evaluate the conceptual validity of a certain thermostatistical framework. 

Ensemble (in)equivalence. Although Sq,S b and other entropy candidates [7J often yield practically indistin¬ 
guishable predictions for the thermodynamic properties of large normal systems [T], such as quasi-ideal gases with 
macroscopic particle numbers, they can produce substantially different predictions for finite mesoscopic systems, for 
ad-hoc truncated Hamiltonians with upper energy bounds or even for macroscopic gravitational systems [25]. This 
implies (see discussion in Sec. |III| below) that, in general, microcanonical and canonical descriptions are not equivalent, 
which is not surprising as they refer to different physical conditions (complete isolation vs. coupling to an infinite 
bath). 


III. TEMPERATURE IN THE CANONICAL ENSEMBLE 

The canonical Boltzmann factor e ~^ H , where T = (fcu/3)^ 1 is commonly identified with the bath temperature, has 
become one of the most frequently employed statistical tools in physics. It is therefore conceptually important and 
practically useful to understand potential validity limits, which arise from assumptions and approximations made 
during the derivation from the underlying MCE. 


A. Boltzmann factor and temperature 


We briefly summarize the key assumptions underlying the derivation of the Boltzmann factor by considering a system 
of interest § which is coupled to another system 23 that acts as a heat bath. The starting point of the derivation is 
the microcanonical density operator p 7 (£\E 7 , Z) = 5[E 7 — H 7 (£, Z)]/uj 7 (E 7 , Z) of the total system T = S + 23. The 
first key assumption en route to the Boltzmann factor is weak coupling , which means that one neglects system-bath 
interaction contributions to the total energy and Hamiltonian, by writing E 7 = E s + E ® and H 7 = H s + H' B . 
Because the total energy E 7 is fixed, the probability weight P(E S \E 7 , Z) to find the fluctuating energy value E s of 
the subsystem S is simply given by mmm 


P(E S \E 7 ,Z) 


w s (£ s )u b (F t -E s ) 
oj 7 {E 7 ) 


( 12 ) 


Here, co s (E s ) denotes the degeneracy of the subsystem energy value E s , while w®(E :B ) is the DoS of the bath at 
energy E® = E 7 — E s , and u> 7 {E 7 ) the total DoS at the total energy E 7 . Equation (12) can be equivalently rewritten 


as 


w s (E s ) 

eoj 7 {E 7 ) 


exp 


'S%(E 7 -E s y 
k B 


P(E S \E 7 ,Z) 


(13) 
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where Sq(E' s ) = S^(E‘ J — E g ) denotes the Boltzmann entropy of the bath. As next step in the standard derivation 
DEB], one expands the Boltzmann entropy in the exponent around some conveniently chosen value E B , typically 
taken to be the expectation value E® of the bath energy 5 , keeping terms up to linear order: 

1 


S’g(E' J - E s ) = Sg{E B ) + 


Tim 


{E J - E h - E B ) + ..., 


(14) 


where T® = (dA® /dE T ')~ 1 is Boltzmann temperature of the bath. Note that Eq. (14) is essentially an expansion in 
the energy fluctuations of the bath SE B = E ® — E B = ( E 7 — E s ) — E B . Inserting the expansion (14) into Eq. (13) 
gives 6 


P{E S \E 7 ,Z ) = 


oo 


'(E S ) 


eoo 7 {E 7 ) 


exp 


Si{E B ) (E 7 - E b ) - E s 


k B Ti(E B ) 


Assuming all higher-order terms can be neglected, one obtains the standard result 


P(E S \E 7 ,Z) = 


oo s (E s ) 


exp 


E s 


k B Ti(E B )\ 


(15) 


(16) 


where all remaining -independent terms have been absorbed into the normalizing constant Zq, which is the canon¬ 
ical partition function. 

Thus, the temperature entering the celebrated Boltzmann factor exp(— j3E s ) is the Boltzmann temperature of 
the bath. One may therefore be tempted to assume that Ti can be identified with the thermodynamic temperature 
of the total system. However, this is logically incorrect because (E®) is in general not equal [7] to the total system 
Boltzmann temperature Ti(E 7 ) or Gibbs temperature Tq(E 7 ), with the latter being the actual thermodynamic tem¬ 
perature. Of course, when the bath is macroscopically large and normal (e.g., ideal gas-like) from a thermostatistical 
viewpoint, then the effective temperature Ti practically coincides with the Gibbs temperatures of the bath 25, the 
system S, and the total system T, and we have Ti = T® = Tq = Tq in this limit. In contrast, when considering finite 
thermostats (i.e., a bath with a finite number of microstates), then the exponential Boltzmann has to be replaced by 
a generalized Boltzmann factor, which may assume the form of a Tsallis-Renyi escort distribution [27]. 


B. Beyond weak coupling 

Having surveyed the notion of temperature in the canonical ensemble, we still address another subtlety that concerns 
the heat capacities of nano-systems. When studying the thermodynamic properties of nano-scale devices, one naturally 
encounters the question whether the weak coupling approximation remains justified. Indeed, for a typical nano-system 
in contact with a heat bath, the coupling energy is usually of the order of the average system energy. Therefore, 
coupling terms in the Hamiltonian can no longer be neglected. This issue was investigated in detail in Refs. P5H5U1 . 
which focused on the question how the canonical heat capacity is affected when nano-subsystems are strongly coupled 
to a large normal bath. These studies showed that the reduced canonical weight (or reduced density operator in 
quantum mechanics) of a strongly coupled small system is no longer of the Boltzmann form, when expressed in terms 
of the bare sub-system energy E s or corresponding Hamilton operator H s . Instead, the canonical weight now features 
a renormalized subsystem Hamiltonian that depends explicitly on both effective bath temperature T B and coupling 
strength. Moreover, as a main consequence, the canonical specific heat of the subsystem is not guaranteed to be 
positive and can, in fact, attain negative values even for T B > 0 }28l 129] . The thermodynamic entropy 7 of such a 
strongly coupled quantum system, obtained from its canonical partition function via the free energy, assumes a form 
that is close (but not exactly equal) to the quantum conditional entropy, and can become negative for T B > 0 [3D] - 
This does not affect, however, the validity of the Third Law as stated above, which holds true for T B —> 0 even when 
a small quantum subsystem is strongly coupled to a heat bath; see Fig. 3 in Ref. m for an example. 


5 Replacing the expansion point E B by the mode is not recommendable, as this procedure becomes ambiguous or even ill-defined when 
the DoS cj® ( E ®) of the bath is oscillating or monotonically increasing. 

6 The approximation neglects all higher-order contributions in the Taylor expansion of 5g. For example, the coefficient in front of 
the quadratic term is proportional to d 2 S^/d 2 E' B = —1/(T& 2 C^), where Cg = dE® /<9Tg is the canonical specific heat of the bath. 
For this term to vanish individually, Cg has to be sufficiently large. Roughly speaking, one can expect that the second-order as well as 
higher-order expansion terms become negligible if the Boltzmann temperature Tg changes only slowly when the bath energy is varied. 
This typically requires a large bath. 

7 For non-weakly coupled systems, correlations between bath and system cannot be neglected and, therefore, the thermodynamic entropy 
of such subsystems is no longer given by the classical Gibbs-Shannon entropy or the quantum-mechanical von-Neumann entropy. 
















C. Thermodynamic vs. information entropy 


We conclude our discussion of the canonical ensemble with brief remarks on thermodynamic and information- 
theoretic entropies. The exponential Boltzmann distribution (16) is directly linked to the entropy Sc = — k^Jr (p In p ), 
as already noted by Gibbs [3] who discussed Sc exclusively in the context of the canonical ensemble. Nowadays, Sc 
is commonly referred to as the canonical Gibbs-Shannon entropy in classical statistical mechanics and as the von 
Neumann entropy in quantum statistics. It is well-known that the canonical distribution (16) can be obtained by 
maximizing Sq under the assumption that the mean energy E s is given. However, such a purely formal ‘derivation’ 
conceals the underlying physical assumptions that determine the range of validity of the Boltzmann distribution (16). 
Also, entropy maximization arguments often leave the impression that there is a direct 1-to-l correspondence between 
thermodynamics and information theory, which is somewhat misleading for a number of reasons: First, there exist 
many different information measures m and the Shannon entropy is just one of them - although an admittedly 
very nice one. Second, the Shannon entropy can be used to quantify the information content of arbitrary probability 
measures that, in most cases, have no relation to the thermodynamic equilibrium distributions. Third, the most 
fundamental equilibrium ensemble, the MCE, has a thermodynamic entropy that does not belong to the class of 
Shannon entropies. Therefore, some reservation seems in order when attempts are made to identify information- 
theoretic measures generically with thermodynamic entropies and vice versa. A similar note of caution applies when 
one tries to relate information-theoretic inequalities to thermodynamic inequalities that arise in the context of the 
Second Law or from thermodynamic stability considerations [26]. Potential analogies between thermodynamics and 
information theory are interesting and deserve to be explored in great detail, but they should not necessarily be raised 
to the level of postulates, when they have been shown to be incomplete and may obscure physical insight. 


IV. OPEN QUESTIONS 

The above discussion implicitly assumed that all derivatives exist and are well behaved. This is typically the case 
for classical Hamiltonian systems with the exception of critical points [13] . as also encountered in the pendulum 
example above m For quantum systems, the problem is generally more subtle since quantum-mechanical energy 
spectra can be partially or completely discrete, and are typically very sensitive to small perturbations that can break 
symmetry-related degeneracies. Similar effects occur in classical approximations to quantum systems, as for example 
the classical Ising model. Whenever one faces a completely or partially discrete spectrum {£(}, the corresponding 
DoS w{E, Z) becomes formally singular and essentially reduces to a collection of d-function at those discrete energy 
values, oj(E) = JA gi5(E — Ei). In this case, the construction of a differentiable DoS requires some sort of smoothing 
procedure. This issue is closely related to the so-called “Weyl problem” of finding asymptotic approximations for 
the eigenvalue distributions of Hermitian operators in finite domains, by applying some suitable averaging procedure 
to obtain a continuous DoS [33] ■ For canonical systems, one typically uses such a smoothed DoS of the underlying 
energy spectrum at high ambient temperatures. 

When the spectrum exhibits a discrete range, then one can define the integrated DoS Sl(E,Z), which enters the 
microcanonical Gibbs entropy S g, in at least two different ways: The most commonly used method simply integrates 
the discrete DoS uj(E , Z ) over E, which results in a step function fl that gives rise to singular thermodynamic 
derivatives. This approach seems unsatisfactory mathematically, for one simply integrates over the ’forbidden’ part 8 
of the spectrum while completely ignoring structural information encoded in the amplitude values gi of ui in the 
interpolation regions (E,. E l+ i). A potentially better method [7] is based on analytic interpolation of the discrete 
level counting function Cl(E n ) = ^2 E<E dim IHy, where 9~Cj is the eigenspace of Ej. Although the most natural 
interpolations appear obvious when fl(E n ) can be written as Cl(E n ) = f(n) for some known function / (see examples 
in Ref. [7]), there remain open questions as to how to treat rigorously cases where no such closed-form representation 
is known. 9 


8 The union of intervals (Ei 5 Ei+l)- 

9 Another practical, but not quite as elegant approach is to replace derivatives with finite differences, which in essence corresponds to 
linear and higher-order polynomial interpolations. 
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V. CONCLUSIONS 

Gibbsian thermodynamics M works consistently for finite and infinite systems, because the underlying mathe¬ 
matical and statistical foundations, most importantly Liouville’s theorem, merely rely on generic conservation laws 
that arise from the Hamiltonian structure of the microscopic dynamics. Working with infinite systems is generally 
easier as this limit often (but not always) forgives a certain laxness in defining entropy and thermostatistical observ¬ 
ables, since different definitions may show the same asymptotic behavior when the particle number N is let to oo. As 
mentioned before, this is quite analogous to the fact that the Newtonian limit c —> oo is generally easier to handle 
than a full relativistic treatment at finite speed of light c, which of course does not mean that Newtonian dynamics is 
more correct than relativity. Just as relativity compels us to think more carefully about how to formulate fundamental 
physical laws, the thermostatistical analysis of finite systems forces us to pay more rigorous attention to mathematical 
and physical consistency criteria |7j in thermodynamics. This profound insight can be attributed to Gibbs, who wrote 
on page 179 of his fundamental treatise [3]: “It would seem that in general averages are the most important, and that 
they lend themselves better to analytical transformations. This consideration would give preference to the system 
of variables in which log V [= S g in our notation] is the analogue of entropy. Moreover, if we make <f> [= Sb in our 
notation] the analogue of entropy, we are embarrassed by the necessity of making numerous exceptions for systems of 
one or two degrees of freedoms.” Gibbs was, of course, well aware that statistical fluctuations become important in 
finite systems and that, therefore, the exact thermodynamic mean value relations © and ([7]) have to be complemented 
by detailed fluctuation analysis, as nowadays the norm in DNA and colloid experiments |2lH23j . 

In this contribution, we have surveyed the notion of thermodynamic temperature in the microcanonical and the 
canonical ensemble. For isolated microcanonical systems, the Gibbs volume entropy fulfills exactly the standard laws 
of thermodynamics as well as equipartion for a wide range of systems, including all classical standard Hamiltonian 
systems regardless of their size. For finite systems, fluctuation analysis provides important physical information 
beyond the mean values that define standard thermodynamic state-variables. The microcanonical Gibbs formalism 
agrees with the Clausius relation [5], implies strictly non-negative temperatures and, hence, ensures Carnot efficiencies 
< 1. By contrast, the Boltzmann entropy, which can yield ‘negative absolute temperatures’, is not a consistent 
thermodynamic entropy if one adopts the standard Laws of Thermodynamics, as summarized in Eqs. ©-©. It is 
therefore not obvious to us why one should favor an entropy that can violate Planck’s law © over one that fulfills it 
rigorously. 

Notwithstanding, the Boltzmann temperature plays an important role as an effective bath temperature in the 
canonical ensemble, describing a subsystem that is in weak contact with a quasi-infinite environment. If the bath 
behaves normally (e.g., ideal gas-like), then the Boltzmann temperature practically coincides with the Gibbs temper¬ 
ature. Subtle differences arise, however, for systems that are non-weakly coupled to an environment, as typically the 
case for nano-scale devices. In the presence of strong coupling, the specific heat of the device can become negative 
[331 :253 even though the total system consisting of device and bath is thermodynamically stable. This feature is in 
stark contrast to the weak-coupling case, where the canonical specific heat of the subsystem is strictly positive. 

Last and least, some authors os [HI [21 have recently criticized the microcanonical Gibbs formalism El E by 
limiting their discussion to infinite systems and advocating modified versions of the thermodynamic laws, tailored to 
favor their own preferred entropy definitions. If one accepts such reasoning, then one must also be willing to replace 
the exact Eqs. © © with inexact approximations - which seems a steep price to pay. The exactness of Eqs. © © 
is not a consequence of specific postulates but follows from basic integral and differential calculus (the ‘proofs’ are 
trivial and take only a few lines 0)- Hence, even if one dislikes the Gibbs formalism as developed in Refs. EIEIE], 
one should at least acknowledge the correctness of the mathematically rigorous results © ©. Moreover, instead of 
focusing on the discussion of abstract postulates [33] , it may also be useful to remind ourselves that the purpose of any 
thermodynamic theory should be the prediction of physically measurable quantities, such as pressure, magnetization, 
etc. which correspond to operationally well-defined statistical averages. We would therefore encourage readers who 
care about the practical applicability of theoretical concepts to perform the following simple numerical experiment: 

1. Place Afi heavy particles (mass toi) and IV 2 light particles 10 (mass m 2 < mi) randomly on a finite ID 
interval [0, L\, and assign to each particle some initial velocity, corresponding to some total energy E = 

(i/2)(E^imwf + E74^ 2 ). 

2. Evolve the system by assuming elastic momentum-conserving point-particle collisions and total reflection at the 
interval boundaries. 


10 Two particle types are required to make the dynamics sufficiently ergodic, if TV = TVi + TV 2 > 1. 
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3. Measure the kinetic temperatures k^T s = ( m s vf) for each species s = 1,2 and the kinetic pressure p , conven¬ 
tionally defined as the mean momentum transfer to the interval boundaries per unit time, by taking standard 
time averages. 

4. Compare T s and p with predictions from the various entropy definitions for any combination (Aq , A r 2 ), starting 
with (1,0), (0,1), (1,1),.... 

If one still intends to discard the Gibbs entropy afterwards, then one will have to explain why it is common sense 
to replace an entropy definition that produces correct predictions for all combinations ( Ni,N 2 ) by another one that 
does not. 
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